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The Teaching Situation Reaction Test (TSRT) , a 
measure of secondary school teachers* effectiveness, was adapted to 
the intermediate elementary grades. The TSRT (Elementary Form) was 
administered to 210 volunteer teachers in the fourth^ fifth, and 
sixth grades in Dayton^ Ohio during January 1969. Two groups Of 
teachers were formed for in-^depth study—those scoring in the top 27 
percent (High Group) and the bottom 27 percent (Low Group) of the 180 
teachers providing useable response sets* Each group contained ae 
teachers. Teachers in the High Group were compared with teachers in 
the Low Group on 25 factors in four categorieai personal^ classroom, 
school environment, and performance. A one-way analysis of variance 
was made by computer^ comparing the means of the two groups of 
teachers on all 25 factors* The F-*test was applied to determine 
significant differences. Results indicated that teachers scoring high 
on the TRST and teachers scoring low represent different samples of 
the population- Further conclusions are Indicated. (A 9-item 
bibliography and related research material are included.) 
(Author/MJM) 
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DEVELOPMENT AND INITIAL VALIDATION OF THE 
TEACHING SITUATION REACTION TEST (ELEMENTARY 
FORM), A MEASURE OF TEACHER EFFECTIVENESS' 



O 
O 

^j- One of the major problems concerning effectiveness of in-servico 

teachers and the prediction of effectiveness during the pre-servlce phase 



is that of selecting appropriate data on which to base an evaluation. Re- 
searchi which reflacts the difference of opinion, has revealed an interesting 
faci - individual measures, such as Intel Mgence tests and the Minnesota 
Multiphasic Parsonallty Inventory, have shown varying degrees of correlation 
with the same, as wall as with different, criterion measures. As early as 
the 1940^5 there was a strong indication that different criteria measure dif- 
ferent things (2), This is not surprising, howfver> when one roallzes that 
teacher effectiveness is most likely influenced by mora than a single factor, 
and that a single trait or Instrument reflects a very narrow range of behavior. 
Measures Used in combination i.ive given somewhat more consistent results. For 
axample, Simun and Asher found that a combination of nine variables in under-- 
graduate school had a significant correlation with administrators' ratings of 
teaching ability (8), But use of several measures Is not practical. 

The problem becomes one of finding a broadly based measure which will 
correlate with accepted criteria of effectiveness* This implies a paper-and- 
pencl I Instrument which will be a quick, indirect measure of ..teacher behavior 
as well as of the product of teaching. Both administrators' ratings and 
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measured pupil change are considered appropriate criteria; ratings hava bean 
generatty acceptad for many years, although recently emphasis has been shifting 
to measurable outcomes of education (!)* 

A few attempts have been made to develop such broad instruments. One, 
the Minnesota Teacher Attitude Inventory, has predictive validity for the 
rather narrow range of behavior it measures, the ability to maintain harmonious 
relationships with pupils. Inconsistent results have been obtained, however, 
In research using other effectiveness criteria (4), Another, Turner 4 set of 
simulated teaching tasks, is limited to specific subject-matter areas (9). 

The Teaching Situation Reaction Test (TSRT) belongs in this category of 
Instruments designed ©specially for measuring teacher effectiveness. It was 
originally developed to help with the study of the effectiveness of pre-servlce 
secondary education courses. Oriented toward Junior-high-school level, the 
TSRT Is comprised of forty-alght sequential problem situations, each with four 
suggested solutions which must be ranked in order of destrabl I ity. The 
situations are subject-matter neutral, and concern common aspects of teaching 
such as planning, classroom management, and teacher-pupil relationships. The 
TSRT was built on the idea that objectivity, empathy, control, confidence, and 
creativity are essential factors In effective responses to classroom situations 
(7:1-3). A high score is believed to Indicate effective teaching. 

The TSRT was developed in 1957 by Duncan and Frymier, Since that time, 
Ami don and Hough have contributed to its refinement^ rekeylng, and expansion, 
and numerous studies of Its reliability and validity have been made. Generally 
speaking, It has been found to have validity for predicting student-teaching 
grade and to bear a positive relationship to administrators' ratings and pupil 
change (5H-I2), The fourth revision (September 1965) was used In research 
conducted by the writer at the sixth-grade level to assess Its validity for 
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elementary school teachersi The results, very briefly, showed a positive 
relationship between teacher score on the TSRT and pupl! change In accep- 
tance of others and grade-point average, but not In the other criterion 
measures of acceptance of self, motivation toward school, and achievement " 
as measured by standardized test C6i 159-70)* The research reported herein 
modlfl&y the TSRT for use with elementary teachers of the Intr.riTied|ate grades 
and studied the relationship between scores on the modified TSRT and 25 other 
variables presumed to be related. 

Modification of TSRT 
The study at slxth-»grada level referred to previously Involved 60 teachers 
In the final sample. These teachers, originally arranged by TSRT score, were 
arranged In order according to the mean gain of their class In acceptance of 
others, and also according to mean class gain In acceptance of self. Each 
teacher was given a rank-order In each listing and the two ranks averaged. The 
resulting averages were ordered, and teachers In the top and bol-^om 21% of the 
composite rank-order were selected for further study. Their responses to each 
Item on the TSRT were analyzed .with the purpose of finding common option-ranking 
patterns within the high group and within the low group. Comparison of patterns 
revealed 29 Items which discriminated between ieQchcrs In the top and bottom 21% 
(that Is, teachers high In promoting pupil acceptance of self and others vs, 
teachers low In promoting pupil acceptance of self and othersj. The option 
ranking for these 29 Items as Indicated by the top group were used as the basis 
of a new scoring key. 

At this point the assistance of three teachers was enlisted ^ one In each 
of the fourth, fifth and sixth grades. They were selected by school officials 
as being "some of the best" teachers. The 19 Items which did not discriminate 



between top and bottom were carefully studied by the three teachers and 
the writer. Some Items were rewritten and for some the answer key was 
altered, always keeping In mind the criterion measures of development of 
acceptance of self and others In pupils. In addition, other wording changes 
were made to make the context more appropriate to the Intermediate grades. 
All changes In the TSRT Itself were kept to the minimum In order to pra-^ 
serve, as much as possible, the factors Inherent In Its construction. The 
remaining Instrument was designated as the Teaching Situation Reaction Test 
(Elementary Form), 

Factors_ReIated to Performance on TSRT 
C EIementary Form) 

Hypotheses . This study, part of a comprehensive one concerning both validity 
and reliability, was designed to determine If teachers scoring high on the 
TSRT CEIementary Form) do In fact possess characteristics which distinguish 
them from teachers scoring low, and which are consistent with the construct 
of the original TSRT* The general hypothesis to be tested was: Teachers who 
score high on the TSRT CEIementary Form) do not differ significantly from 
teachers who score low on any of the measures available for thistf-udy. Two 
specific hypotheses related to the construct were also tested: CI) Teachers 
who score high do not rate significantly higher than teachers who score low 
on the five performance characteristics, related to primary faetors built Into 
the original TSRTj and CZ) Teachers who score high do not rate significantly 
higher than teachers who score low on the principals rating of overall 
teaching effectiveness* 

PrQcedure * The research design Involved examination of the construct validity 
by employing a variation on the known-^groups method. 
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The TSRT (Elementary Form) was adminlstsred to teachtrs in the fourth, 
fifth, apH sixth grades of the Dayton, Ohio, pupllc schools during January, 
1969. Twenty-six of the 50 elementary schools having all three grades were 
selected to participate, representing a cross-sect ion in terms of size, geo- 
graphic location, and socio-economic level. A total of 210 volunteer teachers 
completed the TSRT (Elementary Form), providing 180 useable response sets for 
this part of the comprehensive study* 

Two groups of teachers were formed for in*depth study - those scoring in 
the top 21% of the 180 teachers (High Group), and those scoring In the bottom 
21% (Low Group), Each group contained 48 teachers. A perfect score would be 
288 (5 points for each of the 48 questions). The score range In the High 
Group was 210 to 225, and in the Low Group, 152 to 192, More complete descrip- 
tive statistics on the two groups are provided in Table j. 

As much Information as possible was CQllected on the 95 teachers without 
giving them additional tests. The central office and school principals fur- 
nished personal, situational, and performance data on teachers. 

Teachers in the High Group were compared with teachers In the Low Group 
on 25 factors, which can be roughly grouped Into 4 categories - personal, class- 
room, school-env 1 ronment, and performance. The seven persontM. factors were sex^ 
age, race, years of teaching ©Kperlence, master's degree, bachelor's degree, 
and days absent during the school year- The three classroom factors were size 
of class, mean class score on pupil Acceptance of Self, and mean class score on 
pupil Acceptance of Others. (The last two were obtained by using Bi I I -s Index 
of Adjustment and Values* (3)) The nine school -environment factors were sex of 
principal^ professional attitude of principal (subjective rating by the writer 
based on cooperation, Intirest, understanding, etc,), school sUa - faculty^ 
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school size - pupils^ school climate (subjective rating of faculty based on 
cooperation, friendliness, group cohesi vaness^ etc,)^ mean TSRT score in the 
school, race of pupils, race of faculty, and whether or not school was 
classified as "disadvantaged'' (determined by school system on basis of state 
and federal aid, families on ADC, etc). Factors in the performance category 
were taken from a rating sheet completed by the teacher^s principal - social 
sensitivity, direct control in the classroom, organization, ©motlonai stability, 
staff relationships, and over=al| teaching effectiveness. The first five 
factors were selected as closely representing those supposedly built into the 
or iginal TSRT. 

Findings and Discussion . A simple one-way analysis of variance was made by 
computer^ cQmparing the means of the two groupsof teachers on all 25 factors, 
to discover potential relationships among variables. The F-test was applied, 
to determine significance of differences. Table 2 shows the results of 
analysis of variance^ 14 factors discriminated between the High Group and the 
Low Group. All discriminations shown favored the High Group (higher scores, 
ratings, percentages, etc.).. 

Only one personal factor (race) distinguished between teachers in the 
High and Low Groups, ^a significantly higher proportion of white teachers in 
the High Group thanMn the Low Group, When this is combined with the fact that 
the High Group tended toteach in the schools having a significantly higher 
percentage of both white pupils and white faculty members, two possible ex- 
planations seem worth considering. One^ there are cultural differences which 
influence teachers* reactioni to classroom situations* Two, schools with a 
relatively high percentage of black pupils and faculty have a different Influ- 
ence on a teacher's attitudes toward classroom situations than do schools with 
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white students and faculty. (The influence would be a detrimental or negative 
one if a high TSRT score truly indicates an effective teacher.) 

The only classroom factor which discriminated was class size - High Group 
teachers had larger cJasses. This may not ba surprising when one considers 
that principals rated High Group teachers as significantly more "effective*' 
than Low Group teachers. Is 11 not logical to assign more students to teachers 
who are ''effective''? 

Six of the nine school-envl ronment factors showed a significant difference 
between the two teacher groups^ those related to race^ poverty, and school 
climate. There is a strong relationship between the school environment and 
teacher ^ score, however, it Is impossible to tell from the data available if a 
caus8-=effect relationship exists or, if it does, in which direction It operates. 

All six performance factors discriminated in favor of the High Group • Con- 
sistent significant differences on the first five indicate strongly that the 
construct of the original secondary-school TSRT has been preserved In this 
modification for the elementary school. The highly significant difference on 
the final factor, "Over-^all Effectiveness," suggests that the TSRT (Elementary 
Form) is a valid measure of teacher effectiveness when prinelpaMs ratings are 
the criterion of performance. An Interesting point to be noted Is that the 
difference Is significant at the ,0! level, as compared with the .05 level for 
all of the five factors believed to contribute to effectiveness. There is likely 
another factor(s) Involved which contributes to total effectiveness in a greater 
degree than the five listed. Or, possibly, it is easier for a principal to 
assess a teacher's performance globally rather than by component parts, if for 
no other reason than the lack of universal definitions of the terms used to 
identify the parts. 

On the basis of the findings^ the general hypothesis must be partially 
rejected and the other two hypotheses must be completely rejected. 
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Conclus Ions 

The following conclusions seem warranted, keeping In mind that the 
research was done In a large metropolitan school system and participation 
in the project was voluntary* 

a. Teachers scoring high on the TSRT and teachers scoring low 
represent different samples of the population, as evidenced by significant 
differences on 14 of the 25 factors examined, 

b. The underlying construct of the Qrlglnal TSRT has apparently not 
been appreciably altered In this revision for the Intermediate elementary 
grades. In that teachers scoring high on the TSRT CEIementary Form) are 
considered by their principals to possess the qualities built Into the orlg-- 
inal TSRT to a slgnlf Irantly higher degree than teachers scoring low* 

c. Conditions of the school environment having to do with race, 
climate, and poverty, and teacher effectiveness as indicated by principal's 
rating, are related, as both are significantly related to teacher score on 
the TSRT CEIementary Form)* Additional research Is heeded to determine^ the 
nature of the relationship* The data suggest a definite educational JustlfH 
cation for the current move to desegregate schools and work toward a racial 
balance of both teachers and pupils. 

d* The TSRT CEIementary Form) Is a valid indicator of teacher effective- 
ness In the Intermediate elementary grades when prlncIpaPs rating is used as 
the criterion measure* Additional research Is needed to asses Its validity 
when measured pupll change Is the criterion of effectiveness. 
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TABLE I 

Data on TSRT Scores of High and Low Teacher Groups 



ITEM 



HIGH GROUP 



LOW GROUP 



Number 
Range 

Mean 

Standard Deviation 
Standard Error of Mean 



48 

210-226 
216.44 
4.72 
.68 



48 

152-192 
182.38 
10.37 
1 .50 



Table 2 



Comparison of Teachers In High Group and Low Group on 25 Factors 
Believed to be Related to Teaching Effectiveness 

Factor F Ratio 

Personal 

Sex ...... 0.4393 n,s. 

Age 0.7729 n,s. 

Race (white^ Black) 8,0764 .01 

Years of EKperience 0*0748 n*s. 

Master^ s Degree . • 0*3287 n-s. 

Bachelor* 5 Degree 0.5371 n.s. 

Days Absent 0.8836 n,s. 

CI assroom 

Class Size / 4.6006 ,05 

Mean Pupil Score^ Acceptance of Self 0.0092 n.s. 

Mean Pupil Score, Acceptance of Others 1.7218 n*s. 

Schoo 1 Env i ronment 

Pr inci pa Ps Professional Attitude 9,6720 .01 

Sex of Principal 0,5818 n.s. 

School Climate 6,9030 <,05 

School Size - Faculty - . 1,1354 n,s. 

School Size - Pupils 0,2225' n.s* 

Mean TSRT Score in School 7.2763 .01 

Pupil Race i% white in school) . 5.7364 *05 

Faculty Race i% white in school) 8.1808 ,0! 

Advantaged/Dlsadvantaged Population 16.2000 < *QI 

Performance 



Social Sensitivity . . 5.0349 ,05 

Direct Control ■ 4. 1191 .05 

Organization 5.2132 .05 

Emotional Stability 6.9311 <.05 

Staff ReJationshlps ■ 5.9407 .05 

Over-all Effectiveness 7,6429 .01 

^For last 6 factors, entering the F table with I df between groups and 86 df 

within groups, F, 03=3.95 and F^q|=6.W. For all other factors, entering the 
F table with I df between groups and 94 df within groups, F o5^3.95 and 



